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PREFACE 


Ac  the  request  of  the  U.S.  Postal  Service,  the  Committee  on  Vision 
and  the  Coomlttee  on  Hearing,  Bioacoustics,  and  Biomechanics  established 
a  working  group  to  help  evaluate  visual,  auditory,  and  human  factor  as¬ 
pects  of  the  Multiple  Position  Letter  Sorting  Machine.  Letters  are 
sorted  at  this  machine  by  human  operators  who  read  address  codes  on  let¬ 
ters  displayed  before  them  and  then  direct  the  letters  to  appropriate 
bins  by  operating  a  keyboard.  Studies  of  operator  performance  on  this 
machine  have  yielded  differing  estimates  of  operator  error  rates;  In 
same  cases  a  high  error  rate  was  reported.  The  working  group  was  asked 
for  advice  on  reducing  operator  error  rates  and  to  review  and  comment  on 
studies  proposed  by  a  L’.S.  Postal  Service  task  force  concerned  with  im¬ 
proving  operator  productivity. 

The  working  group  received  a  detailed  briefing  on  the  Multiple  Po¬ 
sition  Letter  Sorting  Machine  and  its  use  from  Rebecca  Cray  of  the  U.S. 
Postal  Service  and  met  with  members  of  the  task  force  to  discuss  oper¬ 
ational  and  personnel  problems.  Two  Installations  were  visited — an  old 
one  at  the  Washington,  D.C.,  post  office  and  a  new  one  at  the  Merrlfleld 
post  office  In  Virginia.  The  working  group  observed  performance  of  all 
operator  functions  of  the  machine  In  these  offices,  questioned  super¬ 
visory  personnel,  and  examined  and  operated  the  keyboard  training  con¬ 
sole.  In  addition,  much  of  the  extensive  literature  on  operator  prob¬ 
lems  associated  with  mall-sorting  machines  was  obtained  and  studied. 

This  report  contains  the  working  group's  evaluation  of  each  of  the 
six  actions  proposed  by  the  U.S.  Postal  Service  task  force.  The  working 
group  found  that  operator  problems  have  already  been  characterized  by 
existing  literature,  and  In  our  Investigation  we  found  no  evidence  of 
major  problems  of  an  auditory  or  visual  nature  that  had  not  been  pre¬ 
viously  Identified.  In  the  course  of  the  study,  however.  It  became 
apparent  that  human  factors  such  as  motivation  and  the  nature  of  the 
operator-machine  Interaction  have  a  major  impact  on  operator  error 
rates.  Consequently,  this  report  Includes  discussion  of  these  human 
factors  and  recommendations  for  related  actions.  Changes  In  operator 
procedures  or  In  the  design  of  the  operator-machine  Interaction  might 
Involve  substantial  personnel  policy  Issues  or  cost  considerations, 
which  are  beyond  the  purview  of  this  report:  thus,  the  conclusions  of 
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this  report  are  presented  In  terms  of  potential  actions  recommended  for 
feasibility  study  by  the  U.S.  Postal  Service. 

The  working  group  acknowledges  the  valuable  assistance  of  Alan  H. 
Harris  of  the  Johns  Hopkins  University  School  of  Medicine  In  assessing 
the  nature  of  stress  Involvement  In  the  letter-sorting  task. 

J.  U.  Cebhard ,  Chairman 
Joint  Working  Croup 


SIMfARY 


The  Joint  working  group  was  asked  by  the  U.S.  Postal  Service  (USPS) 
to  examine  visual,  auditory,  and  human  factors  In  the  operator  use  of 
the  Multiple  Position  Letter  Sorting  Machine  (MPLSM) .  Specifically,  the 
group  was  asked  to  review  and  comment  on  avenues  of  study  proposed  by 
the  USPS  to  reduce  operator  error  rates,  which  are  reported  to  be  un¬ 
acceptably  high  at  some  Installations. 

The  group  concluded  that  changes  In  certain  aspects  of  the  opera¬ 
tor-machine  Interaction  and  In  personnel  procedures  have  potential  for 
considerable  Improvement  in  operator  performance.  Thus  the  group  recom¬ 
mends  that  the  USPS  study  the  feasibility  and  potential  cost-effective¬ 
ness  of : 

1.  Changing  the  MPLSM  from  machine  pacing  to  operator  pacing. 

2.  Providing  an  error  key  to  enable  operators  to  correct 
reading  or  keying  mistakes  they  detect  themselves. 

3.  Providing  on-line  performance  feedback  to  operators. 

4.  Setting  up  a  motivational  system  to  reward  the  achievement 
of  low  error  rates  by  operators. 

Since  these  changes  may  Involve  considerable  expense  and  revision 
of  personnel  policies,  the  USPS  would  need  to  perform  a  comprehensive 
cost-benefit  analysis  to  determine  whether  they  would  be  desirable.  To 
evaluate  the  effectiveness  of  any  change  In  MPLSM  procedures  adequately. 
It  trill  be  necessary  to  Institute  a  program  to  measure  baseline  error 
rate. 


The  group  considered  the  possibility  of  changes  in  operator  seat¬ 
ing,  keyboard  and  coding  arrangement,  operator  work  cycles,  illumination 
and  noise,  and  environmental  heating,  cooling,  and  ventilation.  The 
group  concluded  that  such  changes  would  produce  at  best  only  compara¬ 
tively  small  Improvement  in  operator  performance.  Nevertheless,  because 
of  the  enormous  volume  of  mall  that  Is  currently  handled,  even  small  Im¬ 
provements  In  error  rates  might  produce  appreciable  savings. 
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Finally,  the  group  concluded  that  automatic  sorting  of  mall  by 
machine-readable  codes  has  more  potential  for  producing  low  error  rates 
than  does  any  change  that  might  be  made  In  operator  procedures.  How¬ 
ever,  adoption  of  an  automated  system  could  Involve  major  personnel, 
social,  and  political  considerations  that  go  beyond  the  scope  of  this 
report . 


INTRODUCTION 


Background 

In  order  to  Improve  productivity  on  the  Multiple  Position  Letter 
Sorting  Machine  (MPLSM) ,  the  United  States  Postal  Service  (USPS)  in 
1977  established  an  MPLSM  Job  design  program.  The  plan  of  the  program 
states : 


By  a  detailed  study  of  the  task  requirements,  an 
analysis  of  the  work  station  design,  an  assess¬ 
ment  of  the  work  environment,  and  a  review  of 
potential  occupational  disease  Inducing  Job  fac¬ 
tors,  it  Is  projected  that  a  decrease  in  operator 
errors,  a  reduction  In  Job  turn-over,  and  an  In¬ 
crease  In  Job  satisfaction  can  be  obtained. 

To  accomplish  the  program's  objectives  the  USPS  set  up  a  task 
force,  consisting  of  representatives  ftom  various  branches  related  to 
Its  service  operations,  employee  and  labor  relations,  and  research  and 
development.  This  task  force  Identified  areas  In  which  study  was  needed 
and  outlined  potential  sources  of  Improvement  in  MPLSM  productivity. 

Six  actions  were  proposed: 

1.  To  collect  baseline  operator  performance  data  on  the  MPLSM; 

In  particular,  to  measure  operator  error  rates. 

2.  To  assess  and  specify  the  visual  requirements  of  the  oper¬ 
ator's  tasks. 

3.  To  collect  measurements  of  the  noise  levels  associated 
with  the  MPLSM  and  Its  environment. 

4.  To  collect  measurements  of  potential  physiological  In¬ 
dicators  of  stress  and  fatigue. 

5.  To  assess  the  oc  tal  for  MPLSM  tasks  to  produce 
occupational  disease. 
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6.  To  conduct  a  task  analysis  of  the  operator's  visual 
and  manual  functions  on  the  MPI.SM,  with  particular 
attention  to  the  operations  at  the  keyboard. 

This  report  Includes  an  evaluation  of  each  of  the  task  force's  six 
proposed  actions. 


The  Machine 

The  MPLSM  Is  an  electro-mechanical  machine  about  80  feet  (24.4 
meters)  In  length,  weighing  14  tons  (12,700  kg).  There  are  12  oper¬ 
ator  consoles  on  the  Input  side  of  the  machine  where  the  mall  Is  re¬ 
ceived  for  sorting,  and  277  bins  for  sorted  mall  on  the  output  side, 
better-size  mall  arrives  In  trays  and  is  stacked  manually  on  edge  in 
proper  orientation  on  the  feeder  tray  assembly  of  each  operator  con¬ 
sole.  Stacked  letters  are  then  mechanically  picked  off  the  front  of 
the  stacked  mall  by  a  vacuum  head,  transported  to  a  window,  and  dropped 
on  the  bottom  edge  with  the  address  facing  the  operator.  At  each  of 
the  12  consoles,  trained  operators  read  address  codes  at  the  rate  of 
60  letters  per  minute  and  sequentially  depress  keys  that  send  each 
letter  to  the  designated  destination  bln  on  the  exit  side  of  the 
machine.  MPLSM  operators  spend  30  minutes  at  the  keyboard  console  and 
then  take  turns  at  the  tasks  of  stacking  the  mall  at  the  Input  trays 
and  removing  the  mall  from  the  destination  bins. 


The  Operator's  Task 

The  operator's  task  at  the  consol*  is  a  difficult  one,  and  It  In¬ 
cludes  some  unnatural  responses  that  require  much  practice  to  learn 
proficiently.  The  MPLSM  Is  set  to  automatically  present  one  letter 
per  second  to  an  operator  who  must  first  read  the  ZIP  code  while  the 
letter  Is  stationary  In  the  viewing  area;  then,  after  the  letter  begins 
to  move  out  of  the  viewing  area,  the  operator  must  key  in  the  code.  If 
the  letter  does  not  contain  a  ZIP  code  (which  reportedly  Is  the  case 
for  about  30  percent  of  the  mall),  the  operator  must  recall  from  memory 
the  keypunch  code  for  that  particular  address.  During  the  stationary 
period  the  keyboard  is  Inactive  and  the  machine  will  not  accept  an  in¬ 
put.  Operators,  therefore,  may  key  too  early  or  too  late  in  addition 
to  keying  Inaccurately.  No  mechanism  is  provided  to  correct  mistakes 
detected  by  the  operator. 

Workers  on  the  output  side  of  the  machine  are  responsible  for 
checking  the  contents  of  the  destination  bins  for  letters  keyed  In 
error.  This  task  Is  supposed  to  be  done  simply  by  riffling  a  handful 
of  mall  and  attempting  to  spot  mlssorts  as  they  fan  by. 


FINDINGS  AND  CONCLUSIONS 


Operator  problems  encountered  with  the  machine  sorting  of  mall 
have  been  clearly  recognized  In  previous  studies  (see,  for  example, 
Cornog  1974,  1976;  Devoe  and  Kinsley  1969).  The  working  group  found 
that  MPLSM  operator  problems  are  well  characterized  In  the  literature 
and,  furthermore.  It  found  no  evidence  of  any  other  major  problems 
previously  unrecognized. 


Baseline  Error  Data  Collection 


A  major  recurrent  problem  In  evaluating  operator  performance  on 
the  MPLSM  Is  that  of  determining  what  that  performance  actually  la. 

The  USPS  claims  that  a  12-  to  17-percent  rate  In  distribution  errors 
exists  In  some  offices,  and  other  sources  Indicate  a  range  of  error 
estimates.  A  2-percent  error  rate  was  reported  by  the  Western  Region 
USPS  (1975),  yet  a  report  of  the  Comptroller  General  (U.S.  General 
Accounting  Office  1974)  found  that  30  percent  of  operators  audited  had 
error  rates  of  more  than  10  percent,  and  only  18  percent  had  error 
rates  within  the  2-percent  rate  then  allowed.  As  a  general  procedure 
for  determining  errors  nationwide,  the  Infrequent  audits  conducted  on 
the  operators  by  supervisors  are  not  adequate  for  assessing  the  effect 
of  any  equipment  or  procedural  changes  that  might  be  recotmaended .  Even 
frequent  audits  would  not  eliminate  this  problem  (Devoe  and  Kinsley 
1969;  Cornog  1976);  Cornog  (1976)  notes  that  audits: 


1.  Constitute  an  unknown  mixture  of  man  and  machine  errors 


2.  Sample  only  a  portion  of  the  operator  errors 


3.  Are  difficult  to  track  back  to  the  individual  operator 


Are  not  scored  consistently  from  post  office  to  post 
of  f Ice. 


An  adequate  method  of  measuring  errors  is  required  not  only  to 
provide  baseline  performance  data,  but  also  to  provide  a  possible  means 
for  supplying  frequent  feedback  to  the  operators  to  improve  motivation. 
Such  feedback  Is  not  adequately  provided  by  workers  checking  the  output 
bins  for  mlssorts.  In  fact,  clandestine  observation  of  bln  sweepers  re¬ 
vealed  that  frequently  they  did  not  riffle  the  output  for  errors  at  all 
The  requirement  for  incentive  programs  has  recently  been  recognized  by 
regional  offices  (U.S.  Postal  Service  1974,  1978).  Appendix  A  treats 
In  detail  the  methods  of  measuring  errors  used  by  these  regions. 


The  working  group  also  considered  methods  of  collecting  baseline 
error  data  that  would  assess  the  overall  sorting  performance  of  the 
MPLSM.  In  the  first  method,  the  same  sample  of  mall  supplied  to  an 
MPLSM  la  processed  twice:  first  by  unaelected  operators  assumed  to 
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be  representative  of  the  population;  second  by  selected  operators  known 
to  be  capable  of  achieving  the  2-percent  error  criterion.  The  sorts  by 
these  two  groups  are  then  compared.  In  the  second  method,  mail  that  is 
pre-analyzed  so  that  the  sorts  will  be  known  is  processed  by  the  un¬ 
selected  operators.  Operator  performance  is  then  compared  with  the 
known  sorting.  In  neither  of  these  two  procedures  can  the  errors  be 
traced  to  specific  operators,  nor  can  machine  errors  be  identified. 

A  third  method  Involves  printing  a  code  (machine  number,  console 
number,  and  sequence  of  keys)  on  each  envelope  each  time  an  operator 
uses  the  keys  so  that  each  operator's  sorts  can  be  later  identified. 
Another  method  that  would  identify  the  operators  who  make  errors  is 
to  make  more  extensive  and  systematic  use  of  an  augmented  version  of 
the  present  auditing  computer  than  is  now  done.  However,  these  pro¬ 
cedures,  too,  will  not  identify  those  errors  contributed  exclusively 
by  the  machine.  In  order  to  determine  the  percentage  of  letters 
correctly  keyed  by  the  console  operator  but  directed  to  the  wrong  bins 
by  the  transmission  mechanism  of  the  machine,  a  check  for  the  contents 
of  the  bins  must  be  made.  (This  requirement  also  applies  to  the  ap¬ 
proach  described  below.) 

A  more  ambitious  approach,  which  the  DSPS  might  consider,  would  be 
to  develop  and  apply  a  system  that  would  record  keying  errors  at  the 
console  and,  at  the  same  time,  collect  collateral  data  applicable  to 
other  aspects  of  the  I’SPS  program  plan.  One  such  method  could  be  a 
mobile  system  that  would  record  simultaneously  with  time: 

A  video  tape  view  of  the  operator's  keyboard  and  hands, 
to  determine  finger  motions,  sequences,  delays,  and  keys 
struck.  The  tape  would  Include  a  view  of  the  letter  in 
the  window,  which  would  show  the  7.IP  code,  its  position, 
and  its  legibility. 

A  video  tape  view  of  the  operator's  eyes,  to  show  eye 
movements  in  scanning,  blink  rate,  and  pupillary  changes. 

Electronic  encoding  of  keystroke  operations  on  the  video 
tape,  to  record  effective  keystrokes  and  timing  infor¬ 
mation  in  relation  to  machine  functions. 

From  these  records  it  would  be  possible  to  collect  data  on  keying 
errors,  operator  keying  behavior,  visual  scan  patterns,  and  visual  re¬ 
sponses,  which  may  change  with  time  on  the  console.  It  would  also  be 
possible  to  determine  from  these  records  what  operator  behaviors  are 
associated  with  low  error  rates.  This  information  would  be  useful  In 
the  design  or  refinement  of  training  programs.  Since  these  data  would 
be  time  correlated,  their  Interdependence  can  be  determined.  Such  a 
recording  system  would  be  sophisticated  but  feasible;  more  signifi¬ 
cantly,  the  analysis  of  the  recordings  would  be  time-consuming.  Spe¬ 
cifically,  It  would  be  necessary  to  score  the  recorded  data  manually. 
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It  would  be  desirable  to  apply  this  recording  system  on  a  non-inter¬ 
fering  basis  to  MPLS Ms  located  In  post  offices  in  the  field.  This  may 
be  Impossible;  If  so.  It  would  still  be  valuable  to  Install  such  a  sys¬ 
tem  at  an  MPLSM  simulator  facility. 

Any  procedure  for  measuring  baseline  error  rate  will  be  difficult 
and  costly.  However,  without  such  a  system  the  USPS  will  have  no  basis 
for  evaluating  changes  In  performance  produced  by  modification  of  any 
aspect  of  the  MPLSM  task. 


Visual  Considerations 

The  working  group  found  that  screening  of  new  operators  with  the 
Tltaus  Vision  Tester,  as  Is  currently  done,  Is  adequate  for  the  visual 
requirements  of  the  operator's  task.  The  group  recommends  that  new 
operators  be  required  to  pass  a  near  acuity  test  with  corrected  vision, 
and  that  testing  proceed  in  the  conventional  order  of  right  eye,  left 
eye,  both  eyes.  The  current  testing  for  heterophoria  (squint.  Improper 
functioning  of  the  muscles  controlling  the  eyes).  Is  unnecessary,  but 
visual  field  screening  is  appropriate.  Properly  fitted  eyeglasses,  with 
or  without  bifocal  lenses,  appear  to  present  no  problems,  as  the  operator 
fiscs  the  center  of  the  viewing  window  where  the  letter  Is  stationary 
and  does  not  need  to  search  widely  In  any  direction. 

Although  the  operator's  task  Is  not  sufficiently  demand lng  to  re¬ 
quire  a  comprehensive  ophthalmo logical  examination,  such  an  examination 
might  he  useful  to  the  t?SPS  as  a  baseline  against  which  to  evaluate  any 
future  allegation  of  eye  damage  from  the  onerous  keying  task,  or  If  Ill¬ 
ness  records  shew  appreciable  numbers  of  eye  complaints.  However,  the 
group  sees  no  likelihood  of  Job-related  ophthalmic  disease  resulting  from 
MPLSM  operation  (see  the  section  on  occupational  hazard  and  disease, 
below) . 

At  the  two  Installations  visited,  the  Illumination  level  at  all 
stations  of  the  MPLSM  was  observed  to  be  adequate  for  the  activities 
being  carried  out.  Measurements  of  Illumination  made  at  the  plane  of 
the  letter  for  a  number  of  machine  consoles  showed  values  In  the  range 
of  20  to  140  footcandles  (1  footrandle  -  3.3*2  lumen/m^)  with  the  aux¬ 
iliary  light  rheostat  set,  respectively,  at  mlnl-num  and  maximum.  Since 
reading  the  letters  at  the  console  Is  the  most  critical  visual  task,  a 
level  of  100  ♦  20  effective  footcandles  is  recommended  for  this  work 
station  (Smith  and  Rea  1976;  U.S.  Federal  Energy  Administration  1975) 
and  can  be  achieved  with  the  present  equipment.  Significant  gains  In 
operator  performance  would  not  be  expected  from  a  further  increase  In 
the  level  of  Illumination. ^ 

Tk  comprehensive  assessment  of  the  general  relationship  between 
performance.  Illumination  level,  and  energy  coats  la  being  carried  out 
by  another  working  group  of  the  Committee  on  Vision;  It  Is  expected  to 
be  completed  In  1980. 
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Measurements  taken  In  the  hallways  on  either  side  of  the  machine 
showed  Illumination  levels  generally  falling  within  the  range  of  50  to 
60  footcandles,  which  are  appropriate  to  the  tasks  performed  at  those 
stat Ions. 

While  some  glare  could  be  found  at  the  console  side  of  the  machine, 
the  effect  was  not  considered  severe  enough  to  be  Important.  Indeed, 
glare  control  has  been  accomplished  rather  well,  and  the  treatment  of 
the  local  field  surrounding  the  letter  to  be  read  presented  no  unsatis¬ 
factory  difference  In  contrast. 

The  working  group  considered  visual  aids  for  the  operators,  or 
fitting  the  machine  with  a  magnifier,  but  concluded  that  the  operators 
adequately  read  letters  under  present  conditions  and  that  special  aids 
would  do  nothing  to  enable  the  reader  to  decipher  poorly  written  ad¬ 
dresses  . 


Auditory  Considerations 

Ambient  noise  level  measurements  taken  at  the  Washington,  O.C., 
and  Memphis,  Tennessee,  post  offices  showed  values  In  the  range  of  80 
to  84  dBA  In  the  areas  occupied  by  workers  on  the  MPLSM.  Present  fed¬ 
eral  regulations  on  occupational  noise  exposure  permit  dally  exposure 
to  no  more  than  90  dBA  for  an  8-hour  day,  and  the  levels  measured  are 
well  within  that  limit.  If  noise  levels  at  Installations  not  visited 
by  the  working  group  are  to  be  checked,  measurements  should  be  obtained 
using  a  sound  level  meter  (Type  1  or  Type  II  re:  ANSI  SI. 4-1971)  with 
the  microphone  located  a  few  Inches  from  the  operator's  ear. 

The  dBA  noise  level  measured  at  the  Washington  Installation  Is 
typical  of  the  level  experienced  Inside  the  passenger  cabins  of  Jet 
aircraft.  For  sustained  speech  communication  of  a  critical  nature,  70 
dBA  would  be  a  limiting  ambient  noise  level  (Webster  and  Lepor  1969). 
Letter  sorting  machine  operators  do  not  require  highly  Intelligible 
speech  communication  as  an  essential  part  of  their  Job.  Nevertheless, 
when  necessary,  personal  communication  in  80  dBA  noise  can  still  be 
carried  out  with  the  vocal  effort  normally  expected  In  the  presence  of 
noise  when  the  speakers  are  about  two  feet  apart  (Webster  1970,  1973, 
1979).  Thus,  the  noise  levels  associated  with  the  MPLSM  do  not  elim¬ 
inate  occasional  personal  conversations,  and,  by  keeping  these  conver¬ 
sations  to  a  minimum,  may  In  fact  tend  to  allow  better  concentration 
on  the  Job. 

Some  MPLSM  operators  wear  earphones  while  working  at  the  keyboard. 
Music  fed  Into  these  phones  Is  controlled  by  supervisory  personnel.  The 
earphones,  normally  supplied  with  muffs,  will  produce  about  15  to  20  dBA 
attentuatlon  of  the  80  dBA  noise.  If  the  supervisor  sets  a  music  level 
of  no  more  than  70  dBA,  the  music  can  still  be  comfortably  heard  and 
the  overall  sound  level  at  the  ears  will  be  within  safe  limits.  As  for 


Che  effect  of  music  on  performance,  no  data  can  reliably  predict  atti¬ 
tude  (or  performance).  Some  people  like  It,  some  don't— It  appears  to 
be  a  matter  of  employee  choice,  as  was  observed  at  the  MPLSM  consoles. 
For  operstors  who  simply  wish  to  reduce  noise  level  (without  music), 
effective  earplugs  could  be  provided. 

Laboratory  studies  on  the  effect  of  ambient  noise  on  tssk  perfor¬ 
mance  have  produced  ambiguous  results  (Broadbent  1957;  Cohen  1969;  Kry- 
ter  1960).  Most  studies  have  used  wel 1-mot lvsted  college  students  and 
noise  levels  higher  than  80  dBA.  Generalisation  to  the  MPLSM  situation 
would  be  difficult  even  If  the  results  were  definitive.  Some  studies 
have  noted  that  workers  reported  feelings  of  lrrltsblllty ,  annoyance, 
and  unpleasantness  with  noise  levels  that  produced  no  measurable  dec¬ 
rement  In  performance,  and  this  factor  might  conceivably  contribute  to 
absenteeism  from  the  MPLSM  Job. 

The  working  group  concluded  that  a  noise  level  of  80  dBA  Is  not  a 
limiting  factor  for  Job  performance  on  the  MPLSM  and  that  a  large  effort 
to  reduce  noise  below  80  dBA  would  have  little  effect  on  operator  error 
rates. 


Stress  and  Fatigue 

Stress  and  fatigue  are  poorly  defined  conditions  operationally, 
although  they  are  thought  by  most  people  to  be  well  defined  subjective¬ 
ly.  Of  the  two  conditions,  fatigue  Is  the  better  understood  and  more 
amenable  to  measurement  In  terms  of  performance  decrement  with  time, 
often  accompanied  by  certain  changes  In  body  chemistry.  With  respect 
to  stress  (Mason  1975a,  1975b;  Selye  1975),  physiological  measures  such 
as  heart  rate,  respiration,  blood  or  urine  analysis  for  adrenal  hormones, 
lactic  acid,  and  catecholamines  will  probably  not  reveal  clinically  sig¬ 
nificant  changes  over  the  short  term.  This  question,  however.  Is  an 
empirical  one.  The  National  Institute  of  Occupational  Safety  and 
Health  Is  presently  conducting  studies  relevant  to  this  Issue  (see 
Smith  et  al.  1978). 

A  simple,  unobtrusive  effort  would  be  to  carry  out  an  examination 
of  absenteeism,  turnover  rates,  sick  call,  and  medical  records  for  cosh- 
plaints  of  fatigue  and  stress  In  MPLSM  operators  as  compared  with  other 
Job  classifications  or  In  MPLSM  operators  with  1,  5,  and  10  years  of 
experience  compared  with  one  another.  Such  data.  If  available,  might 
provide  a  measure  of  stress  and  fatigue  that  would  be  both  easier  to 
obtain  and  more  relevant  to  the  USPS  situation.  Another  possibility 
Is  the  administration  of  a  self-report  stress  and  fatigue  Inventory 
specially  tailored  to  the  MPLSM  task.  If  the  composite  recording  sys¬ 
tem  suggested  above  (In  the  section  on  baseline  error  data  collection) 
were  Instituted,  it  might  then  be  useful  to  analyse  reaction  time  and 
eye  response  (blink  rate  and  pupil  diameter)  data  that  would  be  avail¬ 
able,  as  possible  Indicators  of  stress  and  fatigue. 
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Occupational  Hazard  and  Disease 

As  discussed  above,  the  working  group  found  no  evidence  of  visual 
or  auditory  hazard  from  the  MPLSM  operator's  task.  To  determine  whether 
there  are  any  cumulative  health  effects  of  stress  Involved  In  MPLSM 
operation  would  require  long-term  prospective  or  epidemiological  studies 
that  are  beyond  the  scope  of  this  working  group. 


The  Keyboard  Operator's  Task 

The  working  group  considers  the  operator's  task  at  the  keyboard 
console  to  be  a  difficult  one,  and  some  aspects  of  the  keying  response 
require  considerable  practice  to  learn  proficiently.  Nevertheless, 
operators  do  learn  this  demanding,  high-speed,  machine-paced  task  and 
appear,  on  casual  observation,  to  be  keeping  up  with  the  Job.  They  do 
not  seem  to  be  laboring;  they  have  time  to  manipulate  the  keys  and  even 
to  glance  away  from  the  viewing  area  occasionally.  There  remains,  how¬ 
ever,  the  high  error  rate  reported  by  the  USPS,  and  until  the  error 
rate  Is  measured  more  definitively  by  some  system  (such  as  those  de¬ 
scribed  In  this  report),  there  Is  no  way  to  isolate  the  contributing 
t  actors . 

In  Its  analysis  of  operator  keying  activities  the  working  group 
considered  several  procedural  changes  that  might  affect  operator  effi¬ 
ciency.  Major  attention  was  given  to  the  possibility  of  alterations  in 
keyboard  design,  pacing,  detection  of  errors,  error  rate  feedback,  and 
operator  motivation. 


Keyboard  Design 

The  working  group  concluded  that  a  superior  keyboard  and  coding 
layout  could  be  developed  based  on  available  evidence  (Selbel  1972)  or 
In  a  suitable  research  and  development  effort,  but  that  a  better  key¬ 
board  or  code  by  Itself  would  contribute  little  to  reducing  error  rates. 
A  new  keyboard  or  code  might  simplify  and  shorten  the  training  period, 
but  Its  overall  effect  In  the  face  of  the  motivational  problems  that 
beset  MPLSM  operations  would  be  minor.  That  Is,  although  the  MPLSM 
operator  might  be  able  to  go  through  training  more  quickly,  accuracy  of 
performance  by  an  experienced  operator  on  the  Job  would  not  be  expected 
to  be  much  Improved  because  of  a  more  "natural,"  easier-to-learn  key¬ 
board  and  code. 


Form  of  Pacing 

A  number  of  factors  suggest  that  converting  MPLSM  operation  from 
machine  pacing  to  operator  pacing  might  have  a  major  effect  on  operator 
error  rate.  First,  machine-paced  keying  speeds  may  be  too  high  for  some 
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operators  or  too  low  for  others,  or  too  high  for  many  operators  on  "off" 
days,  or  too  high  for  all  operators  when  fatigue  acts  In.  Also,  opera¬ 
tor  pacing  would  let  the  operator  key  while  the  letter  was  stationary, 
allowing  tine  to  read  and  decipher  troublesome  addresses. 

Several  studies  suggest  advantages  of  self-paced  tasks  as  opposed 
to  machine-paced  tasks.  Simple  serial  reaction  times  are  more  accurate 
and  faster  under  self-paced  conditions  (Beck  1963).  Four-choice  reac¬ 
tion  time  responses  are  more  accurate  and  reaction  times  less  variable 
under  self-paced  conditions  (Wagenaar  and  Stakenburg  1975).  A  simu¬ 
lated  Inspection  task  experiment  suggests  (McFarllng  and  Helmstra  1975): 

The  self-paced  Inspection  situation  appears  to  possess 
advantages  with  respect  to  both  performance  and  moti¬ 
vational  aspects... a  self-paced  situation  may  be  struc¬ 
tured  to  encourage  accuracy  rather  than  speed  and  still 
realize  a  reasonable  level  of  total  task  accomplishment. 

In  contrast,  a  machine-paced  situation  may  tend  to  em¬ 
phasize  speed  In  decision  making  even  when  sufficient 
time  does  exist  to  conduct  accurate  Inspection. 

Actual  letter  sorting  In  a  British  post  office  was  studied  by 
Conrad  (1960a,  1960b,  1960c).  The  machines  were  self-paced  with  an  en¬ 
forced  lag  of  0.55  second  following  each  sort.  At  the  end  of  a  year,  av¬ 
erage  production  sorting  rates  approached  60  sorts  per  minute  for  the 
seven  postal  employees  studied.  There  were  some  Important  differences 
between  their  task  and  that  of  MPLSM  operators,  so  direct  comparisons 
are  not  warranted.  However,  the  data  that  are  relevant  are  the  dis¬ 
tributions  of  the  times  (latencies)  between  the  successive  code  entries. 
No  times  were  less  than  0.55  second  because  of  the  lag  built  Into  the 
machine.  By  the  end  of  the  study  approximately  75  to  85  percent  of  the 
latencies  were  1  second  or  less,  with  most  (35  to  60  percent)  within 
the  0.6-  to  0.8-second  range.2  While  the  percentage  may  vary  somewhat 
from  one  operator  to  the  next,  the  Important  generalization  Is  that  the 
skilled  operator  has  adapted  to  the  enforced  lag  and  Is  sorting  at  near 
maximum  rate  for  most  letters.  Despite  this  rapid  performance,  it  is 
most  Important  to  note  that  approximately  20  percent  of  the  latencies 
were  greater  than  1  second.  If  the  task  had  been  machine-paced  at  a 
1-second  rate,  the  distribution  would  probably  have  fewer  latencies  of 
more  than  1  second,  but  there  would  undoubtedly  still  be  some — leading 
to  re-sorts  or  errors  for  those  letters  snd  the  ones  that  followed  them. 
Conrad  does  not  report  error  rates  for  the  self-paced  sorting,  but  the 
dsta  strongly  suggest  that  an  Important  source  of  error  In  the  MPLSM 
operstor's  task  la  the  1-second  machine  pacing. 

2The  percentages  are  estimated  for  a  "typical"  distribution  from 
Figure  2  (Conrad  1960b)  and  Figure  3  (Conrad  1960c). 


These  findings  strongly  suggest  thst  it  would  be  useful  for  the 
USPS  to  institute  s  study  of  MPLSM  operator  performance  in  which  oper¬ 
ator  pacing  is  compared  with  machine  pacing.  This  would  require  an 
adequate  performance  and  error  recording  system,  and  the  overall  cost- 
effectiveness  of  the  two  systems  would  need  to  be  analyzed.  Since  high 
levels  of  skill  develop  slowly  it  would  be  crucial  for  each  operator  in 
such  a  study  to  work  exclusively  under  his  or  her  assigned  p/.cing  con¬ 
dition  for  as  long  as  a  year,  with  relative  performance  evaluated  during 
the  last  several  months. 


Error  Detection  Key 

Skilled  keyboard  operators  themselves  detect  many,  if  not  most,  of 
the  keying  errors  that  they  make,  70  percent  according  to  Klemmer  (1971) 
West  (1969)  reports  this  to  be  true  for  typists,  and  Conrad  (1960c)  re¬ 
ports  It  for  a  simulated  letter-sorting  task.  Klemmer  and  Lockhead 
(1962)  estimate  self-detected  key  punching  errors  to  be  four  times  as 
frequent  as  non-detected  errors  (later  detected  via  verification).  The 
West  study  also  strongly  suggests  that  kinesthetic  (muscular  and  joint) 
sensations  help  the  skilled  typist  to  detect  about  40  to  50  percent  of 
the  total  number  of  errors  made.  Inclusion  of  opportunity  for  the 
skilled  typist  to  visually  check  on  "suspected  self-detected  errors" 
Increases  the  self-detection  rate  to  between  60  and  75  percent.  Visual 
feedback  In  a  self-paced  task  may  make  a  significant  contribution  In 
reducing  undetected  errors.  This  could  be  accomplished  in  the  MPLSM 
situation  by  providing  an  electronic  display  of  the  code  Just  keyed, 
with  the  display  being  positioned  close  to  the  envelope  that  generated 
that  coding  response.  In  conjunction  with  the  display,  operators  could 
be  given  the  capability  to  correct  self-detected  errors  with  a  character 
or  "word"  erase  key  or  be  provided  with  a  separate  key  that  would  at 
least  send  the  Incorrectly  keyed  letter  to  a  re-sort  bln  rather  than  to 
an  Incorrect  bln. 


Error  Rate  Feedback 

The  present  system  of  occasionally  auditing  Individual  operator 
performance  does  not  provide  the  operator  with  adequate  feedback  about 
Individual  error  rate.  A  score,  for  example,  given  after  each  30-mlnute 
period  on  the  machine  would  do  much  to  Increase  Individual  motivation. 
The  working  group  appreciates  the  difficulty  Inherent  In  providing  error 
feedback  on  a  near  continuous  basis  and  sees  no  solution  to  this  problem 
except  by  adding  an  operator  to  the  MPLSM  crew  to  provide  the  necessary 
audits.  The  cost-effectiveness  of  such  an  error  auditor  would  have  to 
be  Investigated. 
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Motivation 

Problems  associated  with  operator  selection,  training,  and  motiva¬ 
tion  have  long  been  recognized  (Cornog  1974;  Devoe  and  Kinsley  1969). 

As  it  now  stands,  the  operator  at  the  console  la  physically  and  psycho¬ 
logically  Isolated,  with  little  Incentive  to  contribute  positively  to 
an  outcome  of  which  he  or  she  has  little  knowledge.  It  was  established 
by  the  USPS  that  some  operators  can  key  with  96-percent  accuracy  in 
selected  trials,  yet  the  operator-wide  average  is  claimed  to  be  far  leas 
than  this.  In  spite  of  high  pay  (over  twice  that  received  by  personnel 
operating  bank  proof  machines),  turnover  and  absenteeism  are  high,  and 
there  Is  much  complaint  about  the  Job. 

The  working  group  considered  several  reasons  for  the  number  of 
complaints.  First,  the  96-percent  criterion  accuracy  rate  la  probably 
perceived  as  unattainable  by  the  majority  of  MPLSM  operators  as  well  as 
their  supervisors,  who  were  formerly  console  operators.  Operators  feel 
that  no  matter  how  hard  they  try,  criterion  performance  Is  not  possible. 
Second,  operators  do  not  associate  desirable  outcomes  of  their  Job,  such 
as  advancement  or  recognition,  with  the  attainment  and  maintenance  of 
low  error  rates.  In  fact.  If  a  dissatisfied  MPLSM  operator  returns  to 
a  less  exacting  Job,  he  or  she  receives  only  a  small  reduction  in  salary. 
Third,  there  Is  no  collective  commitment  to  the  attainment  of  high  ac¬ 
curacy  by  MPLSM  crews.  Since  frequent  feedback  of  measured  error  rates 
is  not  provided,  no  means  Is  available  to  establish  crew  competition. 

It  Is  the  consensus  of  the  working  group  that  attention  to  proce¬ 
dures  to  Increase  operator  Involvement  In  the  MPLSM  task  would  do  much 
to  Improve  performance.  Indeed,  some  members  of  the  group  feel  that 
reducing  error  rates  with  the  present  machinery  Is  primarily  a  personnel 
problem,  not  one  of  technology.  Frequent  error  measurement  and  feedback 
could  be  used  to  develop  a  team  spirit  on  MPLSM  machines,  and.  If  com¬ 
bined  with  a  system  of  reward,  may  reasonably  be  expected  to  reduce 
errors  with  no  effect  on  production  (Herzberg  et  al.  1959).  Appendix  B 
describes  possible  measures  of  this  sort  suggested  by  a  member  of  the 
group. 


The  Automatic  Sorting  of  Mall 

The  working  group  was  not  requested  to  address  the  matter  of  auto¬ 
matically  sorting  letter  mail  by  machine-readable  codes  entered  on  en¬ 
velopes  by  customers  sending  mall.  However,  since  human  error  in  man¬ 
ually  reading  and  key-sorting  mall  Is  so  expensive  and  the  potential 
for  reducing  error  rates  by  manipulating  human  factors  appears  to  be 
very  small  relative  to  accuracy  realizable  through  automation,  the 
group  stroigly  encourages  L'SPS  efforts  to  develop  autoaiatlc  systems  (see 
discussion  in  National  Research  Council  1972).  The  group  is  well  aware 
of  the  difficulties  to  be  faced:  opposition  from  the  public  If  a  for¬ 
matted  code  must  be  entered  In  a  special  area  on  an  envelope;  societal 
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problems  caused  by  replacing  operators  with  machines;  and  the  expense 
of  replacing  one  system  with  another.  However,  the  character  of  send¬ 
ing  stall  la  already  changing  with  the  advent  of  electronic  systems  to 
transmit  some  business  mall  from  point  to  point  (see,  for  example.  Data 
Communications  1977;  Hlrsch  1978),  and  It  is  reasonable  to  expect  that 
private  mall  should  also  undergo  a  change  In  procedure.  None  of  the 
findings  and  recommendations  In  this  report  that  might  lead  to  Improved 
performance  of  manual  systems  can.  In  the  opinion  of  the  working  group, 
come  close  to  the  performance  of  an  automatic  system.  The  Implementa¬ 
tion  of  automation  for  handling  mall,  however,  does  not  eliminate  the 
requirement  for  considering  the  Involvement  of  human  factors.  People 
will  still  be  responsible  for  the  design,  programming,  and  supervision 
of  any  automatic  system.  It  cannot  be  too  strongly  emphasized,  there¬ 
fore,  that  studies  on  human  factors  applicable  to  the  design  and  opera¬ 
tion  of  computer-controlled  equipment  should  be  conducted  In  support  of 
the  development  and  introduction  of  automated  systems  by  the  USPS. 


RECOMMENDATIONS 

During  the  course  of  Its  investigation,  the  working  group  examined 
a  wide  range  of  visual,  auditory,  and  human  factor  considerations  that 
might  bear  upon  the  performance  of  MPLSM  operators;  particular  attention 
was  given  to  operations  at  the  keying  console  where  sorting  errors  are 
made.  The  group  identified  four  aspects  of  the  operator's  task  In  which 
alterations  might  produce  fairly  large  Improvements  In  error  rate:  pac¬ 
ing,  error  detection  and  correction,  error-rate  feedback,  and  motivation. 
Before  Instituting  any  change  in  any  of  these  aspects  of  operation,  the 
USPS  would,  of  course,  need  to  perform  a  thorough  cost-benefit  analysis. 
Such  an  analysis  would  Include  considerations  In  addition  to  the  pro¬ 
duction  of  errors  and  Is  beyond  the  scope  of  this  report. 

The  group  recommends  that  the  USPS  study  the  feasibility  and  cost- 
effectiveness  of  four  possible  changes: 

Instituting  task  pacing  by  the  operator  rather  than  by 
the  machine;  if  operator  pacing  cannot  be  accomplished, 
then  shifting  the  start  of  the  keyboard  acceptance 
period  forward  In  the  cycle  so  that  keying  can  begin 
while  the  letter  is  still  stationary  In  the  viewing 
window  might  lead  to  a  minor  Improvement  in  the  machine- 
paced  task. 

Providing  a  self-detected  error  key  (single  character, 
clear  all  keys,  or  dlrect-to-re-sort  bln)  so  that  the 
operator  may  correct  errors.  Also,  provide  visual 
feedback  of  the  code  Just  keyed,  in  close  proximity 
to  the  envelope  for  which  It  was  Just  keyed,  so  that 
the  MPLSM  operator  may  visually  check  a  suspected  self- 
detected  error  before  sending  the  envelope  to  a  sort  bln. 
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Providing  operators  feedback  at  frequent  Intervals 
on  their  own  error  rates. 

Setting  up  a  motivational  system  based  on  positive 
reinforcement  (reward)  of  low  error  rates. 

A  system  for  measuring  baseline  error  rate  will  be  necessary  in 
order  to  evaluate  the  effectiveness  of  these  or  any  other  changes  In  the 
MPLSM  task.  Thus,  the  working  group  strongly  recommends  the  adoption 
of  a  system  for  collecting  error  data,  such  as  the  ones  described  In  the 
section  on  findings  and  conclusions  and  In  Appendix  B. 

The  working  group  recommends  that  the  USPS  not  Institute  a  program 
to  obtain  on-line  physiological  data  that  may  be  correlated  with  stress 
and  fatigue.  Such  a  study  would  have  to  be  conducted  over  a  very  long 
term  to  have  any  potential  for  showing  results,  and  the  difficulty  and 
uncertainty  of  obtaining  significant  data  argue  against  Including  this 
endeavor  In  the  program  plan  of  the  USPS. 

The  working  group  considered  a  number  of  changes  that  might  be  made 
In  the  physical  environment  of  the  MPLSM  operator  and  concluded  that 
they  would  produce  at  best  only  small  percentage  Improvements  In  opera¬ 
tor  error  rates  (In  comparison  with  the  large  potential  for  Improvement 
by  the  changes  recommended  above  for  study).  Nevertheless,  the  volume 
of  mall  Is  so  largeJ  that  a  very  small  percentage  Improvement  In  the 
MPLSM  operator  error  rate  might  conceivably  produce  Important  monetary 
savings.  Thus,  the  USPS  may  want  to  consider  making  changes  In  some 
aspects  of  MPLSM  operations  even  though  the  group  concludes  that  their 
Impact  on  operator  percentage  error  rate  will  be  small.  Among  these 
the  working  group  considered  changes  In  seating,  keyboard  and  coding 
arrangements,  work  cycles.  Illumination  and  noise,  and  other  environ¬ 
mental  conditions. 

Seating.  A  fully  and  easily  adjustable  chair  with  a  footrest  and 
lockable  casters  could  contribute  to  operator  satisfaction  and  might 
reduce  fatigue  (Comog  1974,  1975;  Lundervold  1958;  Rohmert  1971; 
Tlchauer  1973).  A  footrest  Is  deemed  Important,  but  an  armrest  should 
be  provided  only  to  workers  who  want  one  and  so  should  be  removable. 

Keyboard  and  Coding  Arrangement.  The  present  keyboard  and  coding 
layout  Is  not  of  optimal  design  (Selbel  1972).  Available  evidence 
(Comog  1976;  Selbel  1972)  or  a  new  research  and  development  program 
could  doubtless  suggest  better  ones.  Improved  keyboard  design  might 
reduce  operator  training  time  but  Is  not  likely  to  produce  large  im¬ 
provements  In  performance  by  experienced  operators. 

^Stated  to  be  about  56  billion  pieces  of  flrst-claas  mall  sent 
yearly,  with  a  cost  of  7c  per  misdirected  letter  (correspondence  from 
E.  A.  Danz,  U.S.  Postal  Service,  to  D.  A.  Coslin,  National  Research 
Council,  May  15,  1979). 
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Work  Cycles.  Minor  changes  In  the  time  on  the  console  relative  to 
time  on  the  sweep  side  of  the  machine  will  probably  not  change  perfor¬ 
mance.  Operators  need  adequate  time  to  adapt  to  pacing  and  to  pro¬ 
cessing  a  given  number  of  letters;  they  also  should  not  be  at  the 
console  so  long  as  to  become  fatigued.  The  present  work-rest  cycle 
appeared  to  be  acceptable  to  those  Involved  in  the  system  (Cornog  et 
al.  1969). 

Illumination  and  Noise.  Adequate  lighting  levels  were  observed 
by  the  working  group  In  the  two  Installations  visited.  Optimal  light¬ 
ing,  If  Incorporated,  would  contribute  little  of  substance  to  error 
reduction.  Admittedly,  the  MPLSM  work  environment  Is  noisy  and  any 
efforts  to  reduce  noise  levels  are  endorsed.  However,  there  is  no 
evidence  that  the  current  noise  levels  bear  on  performance,  and 
dramatic  reductions  In  noise  cannot  be  predicted  to  reduce  errors. 

Other  Environmental  Conditions.  Modern  building  design  pays  con¬ 
siderable  attention  to  heating,  cooling,  and  ventilation.  While  such 
matters  may  not  be  optimally  provided  In  some  of  the  older  buildings 
occupied  by  the  USPS,  there  Is  little  likelihood  that  the  environment 
Is  so  out  of  the  range  of  human  comfort  as  to  be  a  major  determinant 
of  mail-sorting  errors.  Thus,  changing  the  environmental  situation 
would  be  expected  to  have  little  effect  (Rohmert  1971). 
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APPENDIX  A: 

COMMENTS  ON  SOME  PROCEDURES  USED  BY  THE  QUALITY 
CONTROL  SYSTEM  Of  THE  U.S.  POSTAL  SERVICE 

Robert  Selbel 


A  comparison  of  the  Western  Region's  Quality  Control  Manual  and 
the  Southern  Region's  System  Quality  Sort  Test  strongly  suggests  that 
the  Southern  procedure  Is  a  small  piece  of  the  Western  procedure.  The 
Southern  procedure  Is  concerned  with  only  the  MPLSM  bln  teat,  while  the 
Western  procedure  Includes  a  MPLSM  bln  test  as  part  of  an  overall 
quality  control  procedure. 

The  Western  procedures.  If  followed  dutifully  and  on  a  national 
scale,  would  go  a  very  long  way  toward  satisfying  a  demand  for  "good" 
statistics  on  error  rates.  All  that  Is  missing  Is  a  (nationally) 
standardised  EDIT  procedure  and  associated  record  keeping  for  keeping 
track  of  each  Individual  operator  (on  an  hourly,  dally,  weekly,  monthly, 
or  annual  basis).  The  records  on  the  Individual  operators  would  provide 
the  sorely  needed  Information  feedback  for  self -monitoring  and  Incentive, 
give  the  supervisors  much  needed  Information,  etc. 

A  suggested  variation  on  EDIT  that  might  Improve  work  Involvement 
and  Incentive  and  be  subjected  to  evaluation  Is: 

1.  Provide  a  separate  EDIT  bln  for  each  keyboard  station. 

2.  Computer  controlled  random  selection  of  sample  of  letters 
(e.g.,  10  every  25  minutes)  from  each  keyboard  station, 
with  appropriate  printout  for  each  station. 

3.  Computer  Immediately  signal  operator  at  each  station  of 
mMber  of  "0"  bln  and  "400"  bin  sorts,  with  some  "very 
obvious"  signals  If  the  proportion  gets  above  some  value 
(e.g.,  2  percent).  Also  Immediately  signal  early  keying, 
late  keying,  or  any  other  "problem"  that  can  be  detected 
without  examining  the  letter  Itself. 

4.  The  correct  keysort  entries  for  each  of  the  letters 
drawn  via  step  2  should  be  entered  In  Ink  on  special 
data  sheets.  After  the  data  sheets  have  been  coexisted 
the  entries  should  be  checked  against  the  computer 
printout.  Data  sheets  and  printouts  should  be  filed 
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for  later  review  by  supervisory  personnel. 

5.  Report  the  results  of  checking  each  operator's  sample  to 
the  Individual  operator,  and  do  ao  for  each  of  their  ses¬ 
sions  at  the  keying  station. 

6.  Enter  results  of  steps  3  and  4  on  a  graph  depicting  each 
operator's  performance  for  the  session,  the  day,  and  the 


7.  The  records  of  step  5  should  be  kept  as  part  of  each 
operator's  performance  file. 

The  need  for  more  than  Just  bln  tests  Is  pointed  out  in  "Report 
to  the  Congress:  Hlssent  Hall — A  contributing  factor  to  mall  delay  and 
Increased  costs  (B-I14874)"  by  the  Comptroller  General  of  the  United 
States,  (U.  S.  General  Accounting  Office  1974):  "Machine  operators 
keyed  9.1  percent  of  the  mall  Incorrectly.  ...  Even  after  screening, 

3.6  percent  of  the  mall  sent  between  States  was  mlasent  due  to  In¬ 
correct  keying  and  machine  error.  ...  An  additional  3.1  percent  of 
the  mall  sent  between  States  was  mlssent  because  correctly  keyed 
mall  was  mishandled  after  sorting."  The  Western  manual  Includes 
what  they  call  Outgoing  Pouch  Tests  (Section  5)  and  Machine  Error 
Rate  Test  procedures  (Section  4,  modified  via  Directive  of  August 
5,  1976).  These  procedures  are  crucial  for  establishing  reasonable 
estimates  of  overall  system  error  rates.  The  Western  manual  recommends 
the  pouch  test  at  least  once  per  week. 

There  are  two  critical  comments  concerning  the  Western  procedures: 
First,  on  page  5-9  (Section  5.5)  for  bundled  mall  In  the  pouch  test-- 
where,  e.g.,  5  pieces  are  to  be  selected  from  a  bundle  "...the  first  5 
letters  of  the  bundle  are  taken  as  the  sample  pieces."  This  may  intro¬ 
duce  a  strong  bias  In  the  estimate.  Second,  the  timing  suggestions  for 
carrying  out  the  various  tests  seem  too  last  for  accuracy.  For  the 
pouch  test  (page  5-8,  Section  5.44)  the  checker  has  Just  under  3.5 
seconds  per  piece  of  mall  (3  hours  55  minutes  for  4,100  pieces);  for 
the  277  bln  test  the  checker  has  Just  under  2.2  seconds  per  piece  (3 
hours  45  minutes  for  6,200  pieces);  and  for  the  40  bln  test  the  checker 
has  1.65  seconds  per  piece  (1  hour  50  minutes  for  4,000  pieces).  That 
seems  very  fast.  In  the  Interest  of  speed,  the  manual  (page  2-14(d)) 
requires  that  sampling  and  checking  be  done  at  the  bln  shelf--othervlse. 
It  takes  too  much  time.  Yet,  on  page  1-25  (Section  1.H5  (d)  6  (e))  they 
recognise  and  comment  on  the  possible  Interference  with  normal  mall  flow. 
It  might  be  better  to  take  a  bit  longer  to  make  the  checks  In  order  to 
aid  checking  accuracy  and  to  avoid  Interference  with  normal  mail  flow. 

(The  Southern  manual  contains  what  may  be  an  error  in  their 
statistics  on  page  18  and  Worksheet  VIII:  The  -1.28  to  4-1.28  should 
be  -1.96  to  4-1.96.) 


InfonMtlon  Processing  end  Performance  Requirements  of  LSM  Operators  within  One  Second 
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of  achievement  that  leada  to  deairable  outcome*  or  objectivea  (Vroom 
1964).  When  the  LSM  operator 'a  motivational  environment  la  conaldered 
In  the  context  of  Ma.  Gray 'a  briefing  and  the  vlait  to  the  Waahlngton 
poat  office,  the  following  polnta  emerge: 

(1)  LSM  operatora  feel  that  no  matter  what  level  of 
effort  la  exerted,  the  probability  that  they  can 
achieve  a  2-percent  error  rate  la  very  low;  and, 

(2)  LSM  operatora  may  aee  little  If  any  relatlonehlp  between 
achieving  very  high  accuracy  ratea  and  dealred  outcome*, 
auch  aa  promotions,  aalary  lncreaaea,  or  recognition  In 
the  form  of  awards  or  commendations  that  are  entered  In 
personnel  files. 

(3)  If  LSM  operators  have  minimal  expectancies  that  their 
efforts  can  lead  to  low  (l.e.,  2-percent)  error  ratea, 
and  they  do  not  perceive  any  significant  relationship 
between  good  performance  (l.e.,  error  rates  in  the 
neighborhood  of  2  percent)  and  the  achievement  of 
dealred  outcomes,  their  motivation  on  the  Job  could 

be  suffering. 

LSM  accuracy,  as  measured  by  supervisors  and  noted  In  personnel 
records,  either  may  not  accurately  reflect  actual  error  rates,  or  may 
not  be  a  criterion  for  satisfactory  job  performance.  Operators,  know¬ 
ing  that  achieving  a  98-percent  accuracy  rate  la  very  difficult  and  that 
It  is  not  necessary  to  perform  at  that  level  to  achieve  dealred  outcomes, 
are  motivated  to  only  perform  at  a  level  at  which  the  error  rate  will 
not  be  patently  obvious  to  the  supervisor. 

Most  LSM  supervisors  are  former  LSM  operators.  As  such,  they  have 
developed  certain  expectancies  about  the  achlevabll lty  of  2-percent 
error  rates.  In  the  Washington  post  office,  two  supervisors  said  oper¬ 
ators  "rarely”  go  below  98-percent  accuracy.  The  general  impression 
conveyed  was  that  the  operation  Is  running  at  about  a  98-percent  accu¬ 
racy  rate.  Whether  the  Washington  post  office  Is  really  operating  at 
a  level  significantly  above  the  estlsuted  error  rate  of  15-22  percent 
Is  Indeterminable.  Supervisors'  statements  that  98-percent  accuracy 
is  being  swlntalned  can  be  based  on  the  fact  that  their  audit  procedures 
Indicate  98-percent  accuracy  or  on  their  general  acquiescence  to  the 
conclusion  that  a  98-percent  accuracy  rate  Is  unattainable.  If  It  la 
assumed  that  supervisors  are  accurately  reporting  on  the  performance  of 
their  machines,  then  the  audit  procedure  may  be  at  fault  for  the  con¬ 
clusion  that  98-percent  accuracy  rate  le  maintained. 

If  operators  can  anticipate  audits  and  be  sure  that  accuracy  la 
high,  then  the  supervisor  has  a  very  poor  vehicle  for  evaluating  per¬ 
formance,  even  if  he  or  she  wanted  to  enforce  a  98-percent  accuracy 
rate.  But  even  if  audit  procedures  could  accurately  reflect  perfor¬ 
mance  and  supervisors  wanted  to  enforce  the  98-percent  accuracy  rate. 
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union  contractual  constraints  appear  to  preclude  the  setting  up  of  re¬ 
inforcement  contingencies  that  depend  on  level  of  performance.  As  this 
set  of  circumstances  becomes  obvious  to  the  LSM  operator.  It  becomes 
equally  obvious  that  salary  Increases,  promotion,  etc.  come  Just  as 
quickly  and  regularly  at  78  or  85-percent  accuracy  as  at  98  percent. 
Consequently,  operators  do  not  perceive  a  2-percent  error  rate  as 
necessary  for  achievement  of  desired  goals  or  objectives.  Not  only  is 
there  a  minimal  expectancy  that  high  accuracy  rates,  such  as  98  percent, 
are  attainable,  but  also  the  perceived  relationships  between  these  high 
accuracy  rates  and  desired  outcomes  such  as  promotion  or  a  salary  in¬ 
crease  may  well  be  nonexistent.  The  two  dimensions  of  the  LSM  operators 
potential  motivational  structure  are  seriously  lacking  according  to  this 
analysis. 

What  can  be  done?  First,  It  would  seem  necessary  to  Increase  oper¬ 
ators'  expectations  that  If  they  try  they  can  achieve  the  level  of  per¬ 
formance  requested  by  management.  In  other  words,  the  accuracy  rate 
has  to  be  made  realistic  so  operators  can  deal  with  It  as  part  of  re¬ 
ality.  There  are  three  ways  this  could  be  done:  lower  the  accuracy 
rate  until  it  Is  "realistic";  slow  down  the  machines;  or,  encourage 
operators  to  make  false  negatives  In  the  training  program  and  on  the 
Job.  (This  point  Is  discussed  below;  a  false  negative  would  be  sending 
a  letter  to  a  re-sort  bln  If  the  operator  Is  distracted,  or  slow,  or 
unsure  of  the  code.) 

(A  ’'realistic"  accuracy  rate  or  a  reasonable  machine  rate  for  some 
level  of  accuracy  will  require  experimentation  with  a  randomly  sampled 
N  of  LSM  operators  using  actual  equipment  In  an  operational  environment 
—  Ideally,  on  the  Job.  But  experimentation  that  manipulates  "acceptable" 
accuracy  rates  or  machine  rates  requires  some  technique  of  accurately 
and  validly  assessing  performance.  This  difficult  problem  has  yet  to 
be  solved  and  Is  mentioned  several  times  In  the  body  of  the  report.) 

Second,  It  appears  critical  to  associate  attainment  and  maintenance 
of  performance  at  specified  accuracy  levels  with  the  potential  achieve¬ 
ment  of  certain  desired  outcomes  or  objectives.  It  Is  Important  to  note 
here  that  the  literature  on  Job  satisfaction  lndlcatea  that  the  factors 
Influencing  satisfaction  are  not  the  Inverse  of  those  causing  dissatis¬ 
faction  (Hersberg  1968).  Factors  such  as  achievement,  recognition,  and 
responsibility  play  an  Important  role  In  engendering  Job  aatiafactlon; 
company  policy,  supervision,  and  work  conditions  are  much  more  salient 
contributors  to  Job  dissatisfaction.  In  order  to  couple  achievement 
of  proficient  performance  with  desired  outcomes  that  will  Increase  Job 
satisfaction  and  motivation  rather  than  merely  avoid  or  minimise  Job 
dissatisfaction,  it  Is  necessary  to  first  ensure  that  the  Input  of  Job 
dissatisfaction  factors  are  minimised  in  the  work  environment. 

Consequently:  LSM  operators  should  be  queried  to  determine  their 
perceptions  regarding  the  acceptability  of  administrative  policy,  super¬ 
vision,  work  conditions,  and  salary  for  their  Job.  It  la  also 
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necesaary  to  design  desirable  outcomes  or  objectives  that  have  to  do 
with  achievement,  recognition,  responsibility,  and  advancement. 

Achievement  and  advancement,  for  exasqile,  could  involve  providing 
feedback  on  personnel  selection  factors  for  supervisors  that  have  to  do 
with  LSM  performance.  This  information  should  be  provided  in  training 
and  in  performance  updates  at  periodic  Intervals. 

For  recognition,  a  system  of  incentives  and  performance  awards 
could  be  developed,  such  as  "Station  of  the  Week"  or  "This  machine  has 
operated  at  _  accuracy  for  _  days." 

For  responsibility,  selected  crews  could  be  allowed  to  determine 
their  own  work  schedules,  strategies  for  maintaining  accuracy,  etc. 

Third,  LSM  operators  must  come  to  perceive  these  outcomes  as  being 
contingent  upon  their  achievement  and  maintenance  of  specified  accuracy 
rates.  In  order  to  concretely  associate  these  desirable  outcomes  with 
performance,  supervisors  have  to  be  able  to  accurately  evaluate  opera¬ 
tors'  error  rates.  To  do  so,  supervisors  should  be  able  to:  audit  any¬ 
one  at  any  time  and  record  satisfactory  performance  in  an  operator's 
personnel  file;  assign  operators  to  retraining  after  appropriate  warn¬ 
ings  or  audits;  and  utilise  a  more  efficient  and  comprehensive  audit 
procedure. 

The  basic  thrust  of  this  approach  is  to  give  the  operator  and  the 
supervisor  a  realistic  error  rate  that  they  know  can  be  obtained  and 
then  couple  Che  attainment  of  this  performance  rate  with  the  potential 
for  achieving  desirable  outcomes  or  objectives.  These  outcomes  should 
be  designed  to  Increase  Job  satisfaction  and  motivation  only  after 
those  factore  that  cause  Job  dlseatlsfactlon  have  been  minimised. 


COLLECTIVE  EFFORT 

It  is  necessary  to  develop  a  collective  effort  on  the  part  of  the 
LSM  station  crew  to  maintain  high  accuracy  levels.  Errors  can  be  caught 
on  both  sides  of  the  sorting  process.  People  removing  mall  from  the 
bins  are  supposed  to  riffle  through  the  letters  that  they  pull  and  then 
place  the  bundle  in  another  bln  on  a  truck.  Thle  is  the  final  check, 
so  to  speak,  of  the  operator's  accuracy.  At  the  Washington  poet  office, 
people  were  observed  on  one  machine  (at  approximately  five  stations) 
performing  this  final  check.  These  Individuals  did  not  know  they  were 
being  observed.  Each  individual  did  Indeed  fan  the  bundle  as  it  was 
removed,  but  at  about  the  speed  that  one  would  use  if  searching  for  a 
green  envelope  in  a  bundle  of  white.  The  bins  were  filling  and  requir¬ 
ing  handling  by  these  operators  at  a  speed  of  about  one  or  two  a  minute. 
A  supervisor  was  then  aaked  to  grab  a  bundle  and  riffle  through  for 
errors.  He  proceeded  to  do  so  et  ebout  a  fifth  the  rate  that  had  been 
observed  in  the  operators. 
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Many  errors  could  be  caught  on  the  other  side  of  the  LSM  if  there 
was  a  team  or  collective  effort  at  each  station  to  hold  the  error  rate 
down.  The  individual  emptying  the  bins  has  ample  time  to  riffle  slowly 
through  the  bundle  of  letters  to  Identify  errors.  And  if  there  was 
sufficient  emphasis  placed  on  accuracy,  perhaps  these  operators  would 
actively  search  the  bundle  for  errors  rather  than  fan  the  bundle  while 
looking  elsewhere. 

How  can  a  collective  commitment  to  accuracy  be  engendered  on  the 
LSM?  One  possibility  Is  to  attempt  to  stabilise  crews  so  that  the  same 
people  are  working  together  for  some  amount  of  time  and  a  certain  amount 
of  group  reliance  can  develop  for  the  achievement  of  an  accuracy  award 
of  some  sort.  This  Is  as  opposed  to  having  the  supervisor  monitor  the 
activity  of  the  person  pulling  bundles  from  the  bins  and  making  sure 
that  more  time  Is  spent  per  riffle.  The  most  effective  solution  to  this 
problem  (l.e.,  getting  the  person  behind  the  machine  motivated  to  find 
errors  In  sorted  bundles)  may  lie  in  a  collective  commitment  to  accuracy 
rather  than  through  an  extension  of  the  supervisory  function.  Since 
there  Is  no  wsy  to  audit  the  accuracy  of  the  bln  puller,  accuracy¬ 
conscious  behaviors  for  these  operators  may  be  hardest  to  motivate.  Two 
questions  remain  unresolved:  What  sort  of  contingencies  can  be  set  up 
for  more  accurate  groups,  and.  Is  there  any  mechanism  by  which  the  bln 
pullers  can  be  audited,  such  as  sending  a  ZIP  code  through  with  letters 
in  it  that  had  to  be  recognized,  and  which  would  be  Inserted  into  the 
mall  flow  at  a  given  rate  by  the  supervisor.  This  sort  of  occasional 
target  would  tend  to  Increase  the  vigilance  of  the  bln  puller. 


EDUCATION  AND  TRAININC 

In  education  and  training,  the  gravity  of  making  a  false  positive 
has  to  be  highly  stressed.  Considering  the  expense  of  a  false  positive 
(when  a  LSM  operator  sends  a  letter  to  the  wrong  bln),  It  would  seem 
preferable  In  the  long  run  If  operators  made  false  negstlves  Instead 
(sending  a  properly  ZIP-coded  letter  to  the  no  ZIP  code  or  unclasslf lable 
bln  or  even  a  bln  designated  as  a  "Panic  Bln"  for  Just  that  purpose). 
During  and  after  training,  the  gravity  of  making  a  false  positive  should 
be  repeatedly  emphasized.  Perhaps  the  exact  magnitude  of  the  problem 
can  be  explained  to  LSM  operators  and  Instructions  given  that  if  for 
some  reason  the  operator  Is  not  able  to  make  a  classification  or  Is 
distracted,  or  whatever,  a  particular  code  designated  as  a  "Panic  Button" 
should  be  hit  but  under  no  circumstances  should  the  operator  try  to 
classify  the  ZIP  code  correctly  and  hit  the  proper  code.  The  "Panic 
Button"  should  be  very  simple.  It  should  also  be  emphasised  that  there 
Is  no  "penalty"  for  false  negatives  (l.e.,  filling  up  the  non-sort  box 
does  not  go  on  one's  performance  record)  but  that  false  positives  that 
are  susceptible  to  audit  do  go  on  one's  record. 

This  general  theme  should  be  Incorporated  Into  the  training  pro¬ 
gram.  Rather  than  having  the  trainee  move  from  one  speed  to  another  and 


b*  allowed  Co  sake  any  number  of  arrora  at  the  new  apeed  Initially  and 
than  reduce  the  error  rata  and  go  to  the  next  speed,  arrora  at  any  spaed 
should  be  discouraged.  Initial  runs  at  new  higher  speeds  that  have  10- 
or  20-percent  error  rates  should  require  the  trainee  to  return  to  the 
earlier  rate  and  relearn  at  that  particular  rate.  Only  after  a  certain 
number  of  errorless  runs  or  runs  at  a  very  low  error  rate  would  the 
trainee  be  allowed  to  advance  again  to  the  next  apeed.  The  training 
program  has  to  emphasize  the  grsvlty  of  making  a  false  positive  and  in¬ 
grain  in  the  trainee  the  notion  of  "if  in  doubt,  use  the  Panic  Code." 

In  brief,  false  positives  seem  to  be  the  problem.  Steps  must  be 
taken  to  get  trainees  to  make  false  negatives  (ssndlng  letters  to 
re-sort  bins)  if  they  are  In  doubt,  or  cannot  remember  a  code,  or  are 
distracted.  Emphasis  on  the  gravity  of  making  a  false  positive  should 
begin  In  the  training  period  and  be  reflected  In  the  training  procedures 
and  should  continue  In  the  supervisors'  hsndllng  of  employees'  perfor¬ 
mance  records. 


OPERATOR  SELECTION 

LSM  operators  should  be  made  to  feel  they  are  a  selected  (not 
necessarily  select)  group.  Do  LSM  operators  really  have  a  better  chance 
at  getting  promoted  or  becoming  supervisors?  If  so,  do  they  know  It? 

Do  ordinary  mall  handlers  apply  for  LSM  Jobs  after  they  have  x  months 
of  experience,  and  do  only  a  certain  percentage  make  It  to  actually 
operating  an  LSM  machine?  If  so,  do  the  operators  know  it?  Can 
attention  be  paid  to  the  working  conditions  of  the  LSM  operators,  or  Is 
this  something  that  is  discouraged  by  the  union?  The  basic  notion  here 
is  that  perhaps  the  LSM  crews  esn  be  msdc  to  feel  that  they  are  a 
selected  group,  and  this  could  be  accomplished  by  feeding  back  any 
Information  to  the  LSM  operators  that  does  Indicate  that  they  are  a 
selected  group  or  taking  measures  that  cause  the  crews  to  get  the 
impression  they  are.  Perhaps  more  rigid  personnel  selection  procedures 
that  may  In  turn  contribute  to  a  different  Job  description  and  store  pay 
are  the  correct  and  union-acceptable  way  to  go  In  this  regard.  In  any 
event,  I  suspect  that  many  constraints  on  this  tack  are  Imposed  by  the 
unions. 


CONCLUSION 

In  addition  to  the  above  suggestions,  I  have  some  final  thoughts. 

A  motivation  and  morale  questionnaire  would  be  In  order  to  get  some 
estimation  of  LSM  operators  perceptions  of  (1)  the  extent  to  which  they 
think  that  they  can  attain  a  98-percent  accuracy  rate;  (2)  the  extent  to 
which  maintenance  of  this  accuracy  rate  influences  their  desired 
objectives;  (3)  the  extent  to  which  they  see  themselves  as  part  of  a 
team  and  a  aelected  group  of  employees  that  are  doing  a  skilled  job; 
end,  (4)  the  Importance  of  factors  lesding  to  job  satisfaction  and 
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dissatisfaction  In  ths  LSM  work  environment.  This  sort  of  questionnaire 
would  lndlcsta  ths  sxtsnt  to  which  By  sbovs  suggestions  srs  on  tsrgst. 

Any  work  that  Is  dons  Is  going  to  naad  sons  Mans  of  accurataly 
assssslng  performance  In  rsallstlc  job  ssttlngs.  This  problem  has  to  bs 
solved  before  any  solution  of farad  by  the  working  group  can  ba  vali¬ 
dated.  I  suspect  that  the  greatest  source  of  variance  In  thla  sort  of 
problem  Is  supplied  by  the  unions.  This  area  (coming  up  with  an 
acceptable  test  for  Ideas  that  allows  accurate  and  representative 
sampling  of  operator/crew  behavior)  should  be  a  topic  of  central  concern. 

Although  It  may  be  beyond  the  scope  of  this  report,  cost-benefit 
considerations  of  any  solutions  will  have  to  be  considered.  For 
example,  suppose  that  the  rate  of  the  Mchlnes  Is  reduced  to  30  letters 
per  minute,  end  the  error  rate  drops  to  1  percent.  Does  this  slowdown 
In  the  voIum  of  Mil  being  handled  require  increased  personnel  and 
machines  such  that  the  eventual  costs  will  exceed  those  Incurred  by  a 
15-  to  22-percent  error  rate  that  Is  based  on  60  letters  per  minute? 
Indeed,  the  possibility  thst  some  solutions  will  have  implications  thst 
will  eventually  cost  mors  thsn  shipping  falsely  clesslfled  letters 
around  the  country  will  have  to  be  considered. 
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